home *** CD-ROM | disk | FTP | other *** search
/ Practical Internet 2002 July / Practical Internet July 2002.iso / pc / Software / FullProgram / sfv5_flashmag.exe / %MAINDIR% / Common Files / parseLang / robots.txt < prev    next >
Encoding:
Text File  |  2002-01-19  |  513 b   |  20 lines
  1. # robots.txt for <3DCUBED NAME="SERVER_PROTOCOL"><3DCUBED NAME="SERVER_HOST"><3DCUBED NAME="SERVER_PATH">
  2.  
  3. User-agent: *
  4.  
  5. Disallow: /basket.html
  6. Disallow: /basketnav.html
  7. Disallow: /button.html
  8. Disallow: /cdata.html
  9. Disallow: /choosecurrency.html
  10. Disallow: /cload.html
  11. Disallow: /core.html
  12. Disallow: /currency.html
  13. Disallow: /fs_menu.html
  14. Disallow: /loading.html
  15. Disallow: /manual_order.html
  16. Disallow: /ordernav.html
  17. Disallow: /ordertotal.html
  18. Disallow: /search.html
  19. Disallow: /viewbasket.html
  20.